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In certain applications, because of noise, compatibility, or other con- 
siderations, it is desirable that a data transmission system have the flexibility 
to operate at multiple speeds. In this paper, a precoding scheme for multiple- 
speed digital or analog data transmission is presented. The scheme has a 
flexibility which allows the data rate and overall channel characteristics 
to be changed simultaneously by simply changing the data format and some 
resistive elements. There is no change in the filters, the equalization, the 
transmitter signaling interval, or the receiver sampling time. By using 
partial response channels, a number of commonly used data rates are 
easily obtained, using a physically realizable precoder and correlator. With 
correct liming and the use of orthonormal siginals, the signal-to-noise ratio 
is maximized at each data rate for bandlimited white noise under the con- 
straints of fixed line signal power and no intersymbol interference. Timing 
error is considered in a two-speed transmission scheme, and the selection of a 
precoding matrix using eye opening as the criterion is studied. This study 
clearly demonstrates the advantage of changing the overall channel char- 
acteristics when changing the data rate. Eye openings obtained are equal to 
or larger than those of two conventional schemes transmitting at the same 
data rates. 

I. INTRODUCTION 

In conventional pulse amplitude modulation (PAM) data transmis- 
sion systems (digital or analog), the signal at the receiver input 
takes the form 

*(0 = Z a k f(l - kT ), (1) 

i = l 

where {a k } are the information symbols, T is the signaling interval, 
and the signals f{t — kT ), k = 1, ••• , N, are time translates of each 

1633 



1634 THE BELL SYSTEM TECHNICAL JOURNAL, SEPTEMBER 1967 

other. It is well known 1 that in order for these systems to meet the 
criterion "Maximize the signal-to-noise ratio in the presence of band- 
limited white noise under the constraints of fixed line signal power and 
no intersymbol interference," the signals should be designed so that 
the overall channel characteristics are in the Nyquist I class and the 
overall amplitude characteristics are divided equally between the trans- 
mitting and the receiving side. Such a signal design scheme (hereafter 
referred to as Scheme I) is popular and is used even if the system de- 
signer is aware that the channel noise may not be white over the fre- 
quency band of interest. This is because the practical determination 
of the noise statistics and the realization of the corresponding optimum 
filters for a general communication complex are nearly impossible. A 
block diagram of Scheme I is shown in Fig. 1. 

In this paper, a precoding signaling scheme (Scheme II) is presented 
for multiple-speed analog or digital data transmission. Scheme II also 
meets the signal-to-noise ratio criterion above. The very distinctive 
difference between Schemes I and II is that in I the signals f(t — fcTo) 
are time translates, but in II the. signals are not necessarily so. This 
property allows the data rate and overall channel characteristics (such 
as represented by the eye opening) of Scheme II to be changed simul- 
taneously without changing the filters, the equalization, the signaling 
interval at the transmitter, or the sampling time at the receiver. 

In Scheme II, a sequence of information symbols is divided into 
blocks and the blocks are transmitted sequentially. For clarity, we 
first consider in Section II the transmission of a single block at a fixed 
data rate and the precoder and the receiver structure. Multiple block 
multispeed transmission and the use of partial response channels are 
considered in Section III. A two-speed transmission scheme, sampling 
time error, and eye patterns are considered in Section IV. 

II. TRANSMISSION OF A SINGLE BLOCK AT A FIXED DATA RATE 

A block diagram of Scheme II is shown in Fig. 2. The quantities 
H(jw) and h{t) are, respectively, the transfer function and the impulse 
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response of the transmission medium. We shall consider H(jn) to be 
bandlimitcd, and 



II (pi) * 0, | to | ^ 2ir/ c 
= 0, otherwise. 



The time interval 



T = — seconds 



(2) 



(3) 



is the Nyquist interval. 



Consider the transmission of a block of symbols a x , • • • , a N . Each 
symbol can be an ra-ary digit (m ^ 2) or a real number. The precoder 
converts a, , • • • , a, v into a sequence of numbers b x , • • • , b N , and the 
number b k , k = 1, • • • , N, is transmitted at t = kT. This produces 
a signal at the input to the receiver given by 



s{t) = £ bji(t - kT). 



(4) 



From (2), the impulse responses hit — kT) are infinitely linearly 
independent, i.e., 



£ b k h{t - kT) = for all t => b k = for all k, 



(5) 



where A r can approach infinity. Equation (5) can be proven by noting 
that the equality 

£ bji(t - kT) - for all t 

k-l 

and (2) together imply that 

£ b k e- iukT = for | « | ^ 2tt/ c . (6) 

A- = l 

Equation (G) then implies that b k = for all k. 
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As is well known, a bandlimited signal, say g(t), can be represented 
by its time samples. The vector whose elements are the time samples of 
g(t) will be referred to as the time sample vector of g(t). For convenience, 
we shall use time sample vectors in discussing the precoder and receiver 
structures, and use the signals themselves in analyzing the overall 
channel characteristics. 

Let hi , a M X 1 vector, be the time sample vector of hit — kT), where 
the value of M will be considered later. Then (4) is equivalent to the 
vector equation 



S = E b*h A 



(7) 



k=\ 



The N vectors h* , k - 1, ■ ■ • , N, are linearly independent since 
the impulse responses h(t — kT) are. Hence, the N vectors h k , k = 
1, • • ' , N, generate a real Euclidean vector space & N of N dimensions. 
If the precoder were not used, we would have b k = a k and S = z2 k=1 a *h* , 
and the information symbols a k would be transmitted as coordinates 
of the basis vectors h k of & N . It is well known that the basis can be 
changed by a linear transformation. A precoder can be used for this pur- 
pose so that a suitable set of basis vectors can be chosen for each trans- 
mission rate of a multi-speed system based on considerations such as 
signal-to-noise ratio and the effect of timing error. 



Define 



A = 



B = 



6, 



H' = 



hi 



_«AT_ 



V = 



VJ 



v/_ 



, (8) 



where V represents a set of basis vectors for S* and the prime notation 
represents transpose. Since h k , k = 1, • • • , N, generate 8 N , V is related 
toHby 

V = HA, (9) 

where A = [\ ti ] is an N X N nonsingular matrix. If a k is transmitted 
as a coordinate of V* , then 



But, from (7) 



S = £ a k V k = VA = HAA. 



S = HB. 



(10) 
(11) 
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From (10) and (11), the precoder structure is 

B = AA. (12) 

Since the noise statistics and the statistics of the customer's data 
are usually unavailable, we choose here not to carry out a usual optimiza- 
tion study on the choice of V using such statistics. In the sequel, V is 
chosen to be a set of orthonormal basis vectors. This enables the pre- 
coding signaling scheme (Scheme II) to meet the following requirements: 

(i) The performance is optimum in the same sense as the popular 
Scheme I described in Section I. 

(ii) The overall channel characteristics are controlled by the precoding 
matrix A and hence by resistive elements. (In Scheme I the overall 
channel characteristics are controlled by the transmitting and receiving 
filters.) 

These requirements are met with a simple receiver structure. The 
noisy signal at the input of the receiver is 

X = S + N = J2 «*V. + N, (13) 

where N is the noise vector. A correlator at the receiver computes 
the decision statistics X'V, , X'V 2 , • • • , X'V N . Since Vi , V 2 , • • • , V lV 
are orthonormal, we have 

X'V t = a k + N'V 4 . (14) 

Because of orthonormality the decision statistic X'V* depends only 
on a k and there is no intersymbol interference. A decision on the symbol 
a k can be made from the decision statistic X'V* by a simple, standard 
decision rule. 

A basic difference between Schemes I and II is that in I the signals 
f(t — kT ) are time translates of each other, but in II the orthogonal 
signals V* are not necessarily time translates. A difference in operation 
between the two schemes is seen in the second requirement. In Scheme I 
the overall channel characteristics are controlled by the transmitting 
and receiving niters. But, in Scheme II, they are controlled by the 
precoding matrix. To illustrate tin's and also for use in Section IV, 
we derive the impulse responses of Scheme II. As shown in Fig. 3, 
the correlator can be implemented with a tapped delay line and N 
sets of attenuators. Only the ;th set of attenuators is shown. The 
attenuation ratios V ix , • • • , V iir shown are the values of the elements 
of V,- , and the decision statistic X'V, is obtained by sampling the output 
of the ;'th summing circuit. For analytical purposes, the tapped delay 
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Fig. 3 — Diagram defining hij (t). 

line, the jth. set of attenuators, and the ;th summing circuit together 
are equivalent to a matched filter having impulse response Vj(t — t), 
where t is the sampling instant and V t (t) is a signal whose time sample 
vector is V,- . Now define 

ha(t) = output of the ;th summing circuit when 

a, = 1 is applied to the precoder. (15) 

Since a, is transmitted by the signal V,- or Vi(t), we have 

hM = ^ V,(t + r - 1)V,(t) dr. (16) 

From (8) and (9) 

V,- = £ X,Jl* . (17) 

A = l 

From (16) and (17) 

h ti (t) -EI h^u r Kk + r- t- kT)h{r - IT) dr. (18) 

It is seen from (18) that, for a given transmission medium, h ti (l) is 
controlled by the elements A,, of the precoding matrix. Since changing 
the precoding matrix requires only changing attenuation ratios in the 
precoder and the correlator, the overall channel characteristics are con- 
trolled by resistive elements. 

III. PRECODING FOR MULTIPLE-SPEED TRANSMISSION 

The transmission of a single block has been considered in Section II. 
Now consider the transmission of an infinite sequence of symbols. 
In Scheme II, a symbol sequence is divided into blocks with N symbols 
in each block. If the vectors hx , • • • , h jV are M X 1 as assumed in 
Section II, the blocks can be transmitted sequentially at MT seconds 
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intervals without interference between each other and the data rate is 

R = Jj # ma x bauds, (19) 

where R max is the Nyquist rate. 

Theoretically there is no limit on the block length N; however, 
we shall restrict N to be small number such as 3 so that the precoder 
and the correlator can be easily implemented. The parameter M must 
be restricted accordingly so that R [see (19)] can be a commonly used 
data rate such as 3/4 of the Nyquist rate. These requirements are 
satisfied by using the popular partial response channels. 2 ' 3 

Table I of Hef. 3 illustrated five classes of partial response channels. 
From the table, it is clear that if h(t) is in Class 1, then a set of sampling 
instants can be chosen (sampling time error will be considered later) such 
that h(t — T), • ■ • , h(t — NT) are simultaneously zero at all except 
N + 1 adjacent sampling points. This means that the vectors h, , ■ • ■ , 
h. v are each (N + 1) X 1 so that 



M = N + 1 

N 
R = at I i fim bauds. 



(20) 



If h(t) is in Class 2, or 3, or 4, sampling instants can be chosen such 
that M — N -f 2. The rule can be easily extended to other classes. 

Consider now multiple-speed operation. As will be shown it is de- 
sirable to change the overall channel characteristics when changing the 
data rate. To make these changes, it is necessary to change the data 
format; however, it is desired that the system not be altered signifi- 
cantly otherwise (such as changing the filters, the equalization, the 
signaling interval, the receiver sampling time, etc.). 

The scheme developed allows the data rate and overall channel 
characteristics to be changed simultaneously by changing only the 
data format and some resistive elements. When the system operates 
as above, the data rate is (N/M)R maT bauds and the sequence of symbols 

a,n_, • • • a v a v+ i • • • 

is transmitted. If the particular channel is noisy, one may wish to reduce 
the baud rate so that signal energy per baud can be increased to combat 
noise (an adaptive technique). The data rate can be changed to 

R = jj flmax bauds, (21) 
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where r can be any integer from 1 to N, by inserting N — r zero digits 
into each block as follows 

di • • • a r • • • a r+1 • • • a 2r • • • a 2r+l • • • 

and transmitting this sequence instead of the original symbol sequence. 
The r information symbols in each block are transmitted to the first 
r summing circuits of the correlator at the receiver, while the N — r 
zero digits in each block are transmitted to the other summing circuits. 
For convenience, let us refer to the transmission path from the precoder 
to the ;th summing circuit as the jth subchannel. Since there is no 
information transmission through the last N — r subchannels, it is 
no longer necessary to consider their performances. The precoding 
matrix A can be changed to improve the performance of the first r 
subchannels (such as reducing the effect of timing error). This can be 
done by changing the resistive elements in the precoder and correlator. 
To summarize, the multiple-speed transmission scheme has the 
following properties : 

(i) Changing data rate and overall channel characteristics requires 
only changing the data format and some resistive elements. There is 
no change to the filters, the equalization, the signaling interval T, 
or the receiver sampling time. 

(ii) With correct timing and the use of orthonormal signals, signal- 
to-noise ratio is maximized at each data rate for band-limited white 
noise under the constraints of fixed fine signal power and no inter- 
symbol interference. 

(Hi) By using partial response channels, commonly used data rates 
are easily obtained, using a physically realizable precoder and correlator. 

The discussions so far are general. To show how the method can be 
applied, and, more important, to demonstrate the advantage of changing 
the overall channel characteristics when changing the data rate, we 
consider in detail a two-speed transmission scheme in Section IV. 

IV. TWO-SPEED TRANSMISSION AND EYE PATTERNS 

Consider the following problem: The transmission medium is equalized 
for transmission at half the Nyquist rate and 

H(ju>) = square root of full-cosine rolloff characteristic 

= kcos^j-, H£%rf. (22) 

= 0, otherwise, 
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where k is a gain factor and / c is the bandwidth. It is recognized that, 
if Scheme I is used, the system is simply the popular full-cosine rolloff 
system transmitting at half the Nyquist rate. 

The channel can be utilized more efficiently if the transmission rate 
can be changed according to the noise level. To compromise between 
efficiency and equipment complexity we choose to consider here two- 
speed transmission and two common data rates, \ and f of the Nyquist 
rate. 

We consider in detail how Scheme II can be used for this purpose. 
Note that H(ju) in (22) is the Class 1 partial response system function. 
Therefore, from (20) and (21) 



R - 



N + 1 



R, un x bauds, 



(23) 



where r can be any integer from 1 to N. To obtain \ R max and f R miiX 
from (23), N can be 3, 7, etc. We choose N = 3 so that the precoder 
and correlator can be easily implemented. 

To obtain the higher data rate, the sequence of information symbols 
is divided into blocks with three digits in each block, where the nth 
block contains the symbols a 3n+1 , a 3n+2 , and a 3n+3 . The blocks are 
applied to the precoder sequentially at AT intervals. The precoder 
converts the symbols a 3n+1 , a 3n+2 , and a 3n+3 in the nth block into 
numbers 6 3n+1 , 6 :)n+2 , and & 3n+3 and transmits 6 3n+l - at t = (4n + i)T. 

Consider the block containing a^ , a 2 , and a 3 . The precoder converts 
a t , a 2 , and a 3 into 6 t , b 2 , and b 3 , and transmits &i , b 2 , and b 3 se- 
quentially at t = T, 27', ST. This produces, as discussed in the previous 
section, a signal at the receiver input as 



X = & 1 h 1 + 6 2 h 2 + & 3 h 3 + N 



(24) 



where the time sample vectors 1^ , h 2 , and h 3 can be written as (omitting 
a gain factor and the common zero samples) 



h, = 



1 












1 


, h 2 = 


1 


, h 3 = 










1 




1 







_0_ 




Llj 



(25) 



Equation (25) shows that if sampling time is correct (timing error 
will be considered later), h x , h 2 , and h 3 are limited to a 47' time interval. 
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Since each block is transmitted in a 4T 7 time interval, there is no inter- 
ference between adjacent blocks. 

The vectors h, , h 2 , and h 3 generate a three-dimensional real Euclidean 
vector space S 3 . Let 



V, = 



v u 




v 21 




v 31 


v i2 


, v 2 = 


\ 22 


, v 3 - 


v 32 


v ia 




v 23 




v 33 


V>*- 




.v 2i _ 




jr*. 



(26) 



be a set of orthonormal basis vectors for S 3 and let a 2 , a 2 , and a 3 
be transmitted as coordinates of Vj , V 2 , and V 3 , respectively. Then 
the signal X at the input of the receiver must also be 

X = OaV, + a 2 V 2 + a 3 V 3 + N. (27) 

The precoder structure then is 

A21 



b 2 

A J 



Xi. 

lx 13 



x 22 

Xu. 



X31 
X32 

Xsji 



(28) 



where the A,/s can be easily determined from (24), (25), (26), and (27). 
This precoder structure can be easily realized (Fig. 4). 

The correlator at the receiver which computes the decision statistics 
X'V, , X'V 2 , and X'V 3 can also be easily realized (Fig. 3, ; = 1, 2, 3 ; 
M = 4). 

It is clear from Figs. 3 and 4 that the precoding matrix can be changed 
by simply changing the resistive elements (the attenuators) in the 
precoder and the correlator. 

The transmission rate is 3/4 R tnnx when the system operates as above. 
To change the transmission rate to 1/2 7? max , zero digits are inserted 
into the original data sequence as follows 

• • • cti a 2 a 3 a 4 a 5 a& • • • , 

and this new sequence is transmitted instead of the original sequence. 
Making use of the reduced baud rate to improve system performance, the 
overall channel characteristic is adjusted simultaneously by changing 
the precoding matrix. This is the subject of the following section. 

4.1 Timing Error and Eye Opening 

So far we have not specified which set of orthonormal basis vectors 
should be used. This is because with perfect timing the system meets 
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Fig. 4 — Precoder for two-speed transmission where \ij, i, j = 1, 2, 3, are at- 
tenuators. 



the signal-to-noise ratio criterion in Section III regardless of which 
set of orthonormal basis vectors is chosen. 

However, in practice, it is impossible to achieve zero sampling time 
error. In general, the receiver will sample the summing circuit outputs 
at t = t n + 8 instead of the correct time t , where 8 is a random timing 
error. Then the system's performance depends on the choice of V\ , V 2 , 
and V 3 , i.e., depends on the choice of A. To determine which A should 
be used, it is necessary to specify the type of transmission and choose 
a performance criterion accordingly. 

In the sequel, we consider digital data transmission. Eye opening 
is adopted as the criterion since it is a widely accepted, practical one 4 
(although considering eye openings in the presence of timing error 
leads to a difficult nonlinear mathematical problem). 

Let r { (t) be the output of the ith. summing circuit when an infinite 
sequence of digits is transmitted at the higher data rate 3/4 R mnx . Then 

r,(0 = E a Sn+i h u (t - 4nT) + E E a^h^t - 4nT), (29) 

n = — co j/i n = -M 

where h ti {{), as defined in (15), is the output of the ;th summing circuit 
when a,- = 1 is transmitted alone. From (IS) and (22) it can be shown 
that 

h it (t) = [X.-.X.x + A,. 2 \,. 2 + X l3 X /3 ]/(0 + [X, 2 Xy. + X i3 X,- 2 ]/« - T) 

+ [X a X,-2 + X„X rt ]J(t + T) 

+ \ i3 \J(t - 2T) + \a\-M + 2T), (30) 
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where 

7YA _ 1 sin 2tt/ c (< - tp) ,„ n 

To evaluate eye opening of r t (t) at t + 8, we assume that the in- 
formation digits {a,} are binary and that each can be \ or — \ (so that 
full eye opening = 1). Then 

E { (8) = Eye opening of r t (t) at t + 8 

= | fe,-.(« + 8) | - El hu((o + 5 - 4nT) | 

n=±l 

-ESI M*» + 5 - 4wr ) I 

», i = 1, 2, 3. (32) 

Similarly, let r J (0 be the output of the ith summing circuit when 
an infinite sequence of digits is transmitted at the lower data rate 
1/2 R max . Since zeros are inserted and no information digit is received 
at the third summing circuit, we need to consider only the eye openings 
E[(8) and E' 2 (8) of r[(t) and r' 2 {t), respectively. 

4.2 Selection of Precoding Matrix 

It is seen that at the higher data rate, we must consider simultaneously 
E x (8), E 2 (8), and E 3 (8), while at the lower data rate we need only to 
consider E[(8) and E' 2 {8). This suggests that a different precoding matrix 
should be selected for each data rate. 

The steps in selection of the precoding matrix are lengthy and are 
outlined in the Appendix. The results are summarized here. 

The precoding matrix selected for the higher data rate is 

X u = 0.21, X ia = 0.62, X 13 = -0.5 

X 21 = -0.68, X 22 = 0.48, X 23 = -0.68 (33) 

X 31 = -0.5, X 32 = 0.62, X 33 = 0.21. 

Eye openings obtained with this precoding matrix are given in Table I 
for 5 = 0, zfcO.17 1 , iO.27 1 , iO.37 7 (it is a reasonable expectation that 
the timing error 8 will amount to no more than iO.27 7 ). Also given 
in Table I is the eye opening i?(5) of the popular "raised cosine" rolloff 
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Table I — Comparison of Eye Openings 



Timing Error 6 


Ei(S) 


&(*) 


E,(S) 


E(S) 


-0.3T 


0.312 


0.41S 


0.351 


0.312 


-0.2T 


0.559 


0.625 


0.575 


0.551 


-0.1T 


0.790 


0.S21 


0.793 


0.783 





1.000 


1.000 


1.000 


1.000 


0.1T 


0.793 


0.821 


0.790 


0.783 


0.2T 


0.575 


0.625 


0.559 


0.551 


0.3T 


0.351 


0.418 


0.312 


0.312 



system 8 which transmits at the same data rate 3/4 R max (i.e., which 
utilizes a 33.3 percent rolloff band). A glance shows that the eye openings 
Bi(S), E 2 (8), and E 3 (8) are equal to or larger than the eye opening 
E(8) of the conventional system. 

The precoding matrix selected for the lower data rate is 

An = -jz > A ia = 0, X13 = 

X21 = 0, X 2 2 = 0, X23 = Tjr > 



where X-, 



and X33 can be arbitrary since no information digit 



is transmitted through the third subchannel. With this precoding 
matrix, the system is identical with the popular "full cosine" rolloff 
system at the lower data rate, and the eye openings E[(8) and E' 2 (8) 
are both 1.00, 0.955, 0.S96, and 0.S23, respectively, for 8 equal to 
0, ±0.1 jT, iO.27 1 , and ±0.37*. These eye openings are much larger 
than E t (8) and E 2 (8) in Table I. This clearly demonstrates the advantage 
of changing the precoding matrix when changing the transmission rate. 



V. CONCLUSIONS 

A precoding scheme is presented for multiple-speed digital or analog 
data transmission. The scheme has the following properties 

(i) Changing data rate and overall channel characteristics requires 
only changing the data format and some resistive elements. There is 
no change to the filters, the equalization, the transmitter signaling 
interval, or the receiver sampling time. 

(ii) With correct timing and the use of orthonormal signals, the signal- 
to-noise ratio is maximized at each data rate for band-limited white 
noise under the constraints of fixed line signal power and no intersymbol 
interference. 
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{Hi) By using partial response channels, a number of commonly used 
data rates are easily obtained using a physically realizable precoder and 
correlator. 

Timing error is considered in a two-speed transmission scheme. Eye 
openings are used as the criterion in selecting the precoding matrix. 
Eye openings obtained are equal to or larger than those of two conven- 
tional schemes transmitting at the same data rates. The study clearly 
demonstrates the advantage of changing the overall channel charac- 
teristics when changing the data rate. 

APPENDIX 

Selection of Precoding Matrix 

As can be seen from (32), (30), and (31), the problem of finding a 
precoding matrix for maximizing the eye openings in some joint sense 
over a certain range of the random variable 8 is nonlinear and mathe- 
matically intractable. In the following, we reduce the dimension and 
range of the precoding-matrix space S = {A} to a minimum by using 
constraints and properties of S, then derive a guide for searching the 
reduced space. Eye openings are obtained equal to or larger than those 
of two conventional schemes transmitting at the same data rates. 

Consider the higher data rate. The eye openings E l (d), E 2 (8), and 
E*(8) are determined by the nine parameters X,,- , t, 3 = 1, 2, 3. We 
have from orthogonality of V x , V 2 , and V 3 

M40-O, i, 7 = 1,2, 3; i*j. (34) 

Define for i = 1, 2, 3 

w > = k + b c < = t + 1 2 (35) 

It can be shown from (30), (31), and (35) that (34) is equivalent to 
the constraints 

C£,--W i W t -l, i, J = 1,2, 3; i * j. (36) 

Equation (36) is satisfied if and only if one of the following condi- 
tions holds 
(0 WiW § ^ -i W 2 W 3 ^ -§, W 3 W r ^ -\ (37) 

(it) WJT, ^ -h W 2 W 3 ^ -h, W i W 1 ^ -h (38) 

(Hi) W,W 2 ^ -h W 2 W 3 ^ -i WW ^ -1 (39) 

(iv) W,W 2 ^ -h W 2 W 3 ^ -i W 3 W, ^ -I. (40) 
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Each of the four conditions specifies a subspace of S. Equation (37) 
corresponds to a null space because its requirements are conflicting. 
Equations (39) and (40) can be obtained from (38) by rotating the 
indexes of If; hence, for every point P in the subspace of (39) or (40), 
(here is a point Q in the subspace of (38) such that P and Q produce 
eye openings differing only in indexes (for instance, P produces E x (8) = 
a(8),E 2 (8) = 0(8), and E 3 (8) = y(8);Q produces £,(«) - y(8),E 2 (8) = 
a(8), and E :I (8) = /3(5)). Since they are the same set of eye openings, 
we need only to cover the subspace of (3S) in searching for A. 

The subspace of (3S) can be further narrowed. It can be shown that 
(38) holds if and only if 

W X W 2 ^ -\, If ,!f 3 ^ 0, -h S W a W t ^ (41) 

or 

ii'.if, =g -i, -\ ^ w 2 w 3 ^ o, w M w, ^ o. (42) 

Equation (42) can be obtained from (41) by exchanging W x and If 2 . 
Thus, for the reason just cited, we need to search only the subspace 
of (41) instead of that of (38). 

To further reduce S, we divide the subspace of (41) into two subspaces 

(i) W,W 2 g -|, If 2 Tf 3 £ 0, -IS W,W 1 ^ -\ (43) 

(ii) W x Wi ^ -I, lf 2 If 3 ^ 0, -\ S W i W 1 ^ 0. (44) 

From (3G), (44) can be written as 

C 2 C 3 ^ -|, C t C 2 £ 0, -§ S C t C z ^ -I. (44a) 

It can be shown from (32), (30), and (35) that simultaneously exchanging 
]\\ and C\ , If 2 and C 2 , and Jf 3 and C 3 does not change the eye openings. 
From this it can be shown that for every point P in the subspace of 
(43), there is a point Q in the subspace of (44a) such that P and Q 
have eye openings differing only in indexes. Since (44a) is equivalent 
to (44), this implies that only the subspace of (44) needs to be searched 
instead of that of (41). 

The space S to be searched has been reduced to only that of (44). 
The If 2 — If 3 plane is reduced to a narrow strip for all W\ 9^ 0. For 
instance, for W, = —1, Tf 3 is bounded between and \, and W 2 and 
If 3 are bounded in the very narrow strip shown in Fig. 5. 

Each point (Tf , , If 2 , If 3) in the subspace of (44) determines a 
precoding matrix through (36), (35), and the orthonormality condi- 
tion hji(t ) = 1. 
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Fig. 5 — Region of W s and W 3 (shaded) when II'i = — 1. 

Usually it is desirable that the three eye openings Ei(8), E 2 (S), 
and E 3 (8) be approximately equal. It can be shown from (32), (30), 
and (31) that £\(5) and E 3 (8) are approximately equal if 



w x = c 3 



W 2 = C 2 , and W 3 = d . 



Equation (45) defines the following region in the subspace of (44) 
1 m 2TT, „ r 1 



W x 



>2' 



W 2 = - 



±W\ - 1 



PT a = - 



4W^ 



(45) 



(40) 



E 2 (8) is larger than E^S) and 2? 3 (5) at one extreme of the range J W x \ > i, 
and is smaller at the other extreme. Therefore, in the region of (46), 
there are points at which E^S), E 2 (8), and E 3 (8) are approximately 
equal. A simple search of this one-dimensional region gives one of such 
points as 

Wt = 0.84, W 2 = -0.92, W 3 = -0.3. 

This point gives the precoding matrix in (33). Table I in Section IV 
shows that by using this precoding matrix for the higher data rate, 
the system has eye openings equal to or larger than the eye openings 
of a "raised cosine" rolloff system transmitting at the same data rate. 

After the precoding matrix in (33) was obtained from the region of 
(46), the rest of the subspace of (44) was searched. About 5000 points 
were covered. It was found that no point had eye openings Ei(8), E a (8), 
and E 3 (8) simultaneously larger than those in Table I. 

A similar study for the lower data rate produced the result in Sec- 
tion IV. 
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